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Abstract 



Quantum computation by adiabatic evolution, as described in quant-ph / 0001 10^ , will 



solve satisfiability problems if the running time is long enough. In certain special cases 
(that are classically easy) we know that the quantum algorithm requires a running time 
that grows as a polynomial in the number of bits. In this paper we present numerical 
results on randomly generated instances of an NP-complete problem and of a problem 
that can be solved classically in polynomial time. We simulate a quantum computer (of 
up to 16 qubits) by integrating the Schrodinger equation on a conventional computer. 
For both problems considered, for the set of instances studied, the required running 
time appears to grow slowly as a function of the number of bits. 



1 Introduction 

A quantum algorithm for the satisfiability problem was presented in [1]. This algorithm is 
based on quantum adiabatic evolution. If a state \ip(t)) evolves according to the Schrodinger 
equation with a slowly varying Hamiltonian H(t) and |^(0)) is the ground state of H(0), 
then \ip(t)) will stay close to the instantaneous ground state of H(t). The Hamiltonian H(t) 
used in the algorithm is designed so that the ground state of H(0) is easy to construct and 
the ground state of H(T) encodes the solution to the instance of satisfiability. A crucial 
question is how large must the running time, T, be to achieve an acceptable probability 
of success. In this paper we simulate an n-qubit continuous time quantum computer by 
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numerically integrating the Schrodinger equation in a 2 n -dimensional Hilbert space. We 
randomly generate difficult instances of an NP-complete problem and study how large T 
must be as a function of the number of bits n. For 7 < n < 16, we find that the required T 
grows modestly with n since the data is well fit by a quadratic in n. 

2 A quantum algorithm based on adiabatic evolution 

An n-bit instance of satisfiability is a Boolean formula with M clauses 

d A C 2 A • • • A C M (2.1) 

where each clause C a is True or False depending on the values of some subset of the n bits. 
The task is to discover if one (or more) of the 2 n possible assignments of the values of the n 
bits satisfies all of the clauses, that is, makes formula ( |2.1|) True. We consider two restricted 
versions of satisfiability, both of which are restricted versions of a problem called "exact 
cover". In the first, EC3, each clause involves only three bits. The clause always has the 
same form. The clause is True if and only if one of the three bits is a 1 and the other two are 
0, so there are three satisfying assignments out of the eight possible values of the three bits. 
The second, EC2, has the restriction that each clause involves only two bits. In this case the 
clause is True if and only if the two bits have the value 01 or 10, so there are two satisfying 
assignments out of the four possible values for the two bits. We pick these two examples 
because EC2 is classically solvable in polynomial time whereas EC3 is NP-complete and no 
polynomial time algorithm is known. It is interesting to see how the quantum algorithm 
treats these two classically very different problems. 

To understand the quantum algorithm we first recall the content of the adiabatic theorem. 
We are given a Hamiltonian H(s) that depends smoothly on the parameter s where s varies 
from to 1. Suppose that for each value of s, H(s) has a unique lowest energy state, the 
ground state \g; s). That is, 

H{s)\g;s) = E (s)\g;s) (2.2) 

where Eq(s) is strictly less than any of the other eigenvalues of H(s). Introduce a time scale 
T and define a time-dependent Hamiltonian H(t) by 

H(t) = H(t/T) (2.3) 

where t varies from to T. As T gets bigger, H(t) becomes more slowly varying. Let \i/)(t)) 
obey the Schrodinger equation 

4lVW> = H(t)\m) (2-4) 



with 

1-0(0)) = \g;s = 0). 



(2.5) 
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That is, at t = 0, ^(O)) is the ground state of H(0). The adiabatic theorem tells us that 

lim|<0;a = l|V>(r))| = l. (2-6) 

1 — >oo 

This means that for T large enough, \ip(T)) is (up to a phase) very close to the ground state 
of H(T). Eq. Q2.6|) only holds if the gap between the ground state energy, E (s) of H(s), and 
the next highest energy, Ei(s) of H(s), is strictly greater than zero, that is, Ei(s) — Eq(s) > 
for < s < 1. We will also discuss cases where at s = 1 there are multiple ground states. 
In this situation the evolution ends very close to the ground state subspace. 

The idea behind the quantum algorithm is the following. Given an instance of the satis- 
fiability problem it is straightforward to construct a Hamiltonian, Hp, whose ground state 
corresponds to an assignment of the bits that violates the least number of clauses. Although 
it is easy to construct Hp, finding its ground state may be computationally challenging. 
However we can construct a Hamiltonian Hp, whose ground state we explicitly know. Now 
let 

H(s) = (1 - s)H B + sHp (2.7) 

and accordingly 

H(t) = (1 - t/T)H B + (t/T)Hp (2.8) 

for some fixed T. We start our quantum system in the known ground state of Hp and then 
evolve according to Eq. ( |2.4j) for time T. Suppose that the instance of satisfiability that gave 
rise to Hp has a unique satisfying assignment. If T is large enough, then \ip(T)) will be very 
close to the ground state of Hp. Measuring \ijj(T)) will, with high probability, produce the 
satisfying assignment. In general this algorithm will produce an assignment that violates the 
minimum number of clauses in Eq. ( |2.1p . Restricting to instances with a unique satisfying 
assignment appears to pick out difficult instances and simplifies the analysis of our algorithm. 

More explicitly, given an n-bit instance of satisfiability, we work in an n-qubit Hilbert 
space that is spanned by the 2 n basis vectors |zi)|z 2 ) • • • \z n ) where Zi — 0, 1 and \zi) is an 
eigenstate of the z component of the i th spin, 

|(1-<7«)|^> = ^) where each <r« = ( J (2.9) 

We also need the eigenstates of the x component of the i th spin, 

1^ = 0) = ■j={\zi = 0) + \z i = l)) 

and 

|^ = 1) = —(|^ = 0) -|zi = l» (2.10) 

that obey 

|(1 — a^) \xi = x) = x \xi = x) where each a® — ( ) . (2-H) 
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For concreteness imagine that each clause in formula ( j2.ip involves 3 bits. Let ic,jc and 
kc be the 3 bits associated with clause C. For each clause C define an "energy" function 

i o, if r 

z ici z ici z kc) satisfies clause C /nm\ 
h c {z ic ,z jc ,z kc ) = \ C JC c _ ( 212 ) 

[ 1, if (2i c , Zj c , Zk c ) violates clause u. 
We immediately turn these into quantum operators 

Hp, c (\zi)\z2) ■ ■ ■ \z n )) = h c (z ic ,z jc ,z kc )\z 1 )\z 2 ) ■ ■ ■ \z n ) (2.13) 

and define 

H P = J2H P , C . (2.14) 

c 

By construction Hp is nonnegative, that is, (ip\Hp\ip) > for all and Hp\ip) = if 
and only if is a superposition of states of the form |2 1 )|z 2 ) ■ • • \z n ) where the bit string 
Z\Z 2 . . . z n satisfies all of the clauses. In this context seeing if formula ( [2.1|) has a satisfying 
assignment is accomplished by finding the ground state of Hp. If formula (|2.1|) has no 
satisfying assignment, the ground state (or states) of Hp correspond to the assignment (or 
assignments) that violate the least number of clauses. 

Hp given by Eq. fl2.14| ) is the problem Hamiltonian whose ground state we seek when we 
run the quantum algorithm. For the beginning Hamiltonian Hp, first define 

*4° = i(l-4 )- (2-15) 
For each clause C, involving bits ic,jc, and kc, let 

Hp, c =H^ ) + H { i c) + H i i c) . (2.16) 
The beginning Hamiltonian is given by 



H b = J2H b , c . (2.17) 

c 



The ground state of Hp is 



\ Xl = 0) \x 2 = 0) • • • \x n = 0) = £ X) • • • E l^i>l^> • • • \zn) (2-18) 



2 n/2 



which we will take to be the initial state when we run the quantum algorithm. 

The Hamiltonian that governs the evolution of the quantum system is given by Eq. (|2.8| ) 
with Hp specified in Eq. ( p.!4| ) and Hp specified in Eq. fl2.17|) . Note that H(t) is a sum of 
terms, each of which is associated with one of the clauses in (|2.1]) . 



H(t)=Y,H c (t) (2.19) 

c 

where 

H c (t) = (1 - t/T)H B , c +(t/T)Hp, c ■ (2.20) 
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Each Hc(t) involves only the bits associated with clause C and therefore H(t) is a sum of 
terms each of which involves a fixed number of bits. 

For a given problem such as EC3 or EC2 we must specify the running time as a function 
of the number of bits, T(n). Since the state \ip(T)) is not exactly the ground state of Hp we 
must also specify R(n), the number of times we repeat the quantum evolution in order to 
have a desired probability of success. This paper can be viewed as an attempt to determine 
T{n) and R(n) by numerical methods. 

We now summarize the ingredients of the quantum adiabatic evolution algorithm. Given 
a problem and an n-bit instance, we assume we know the instance-independent running time 
T(n) and repetition number R(n). For the instance and given T(n), 

1. Construct the time-dependent Hamiltonian H(t) given by Eq. ( |2.8| ) with Hp and Hp 
given by Eq. ([TLj) and Eq. (pT7| ). 

2. Start the quantum system in the state ^(O)) given by Eq. (|2.18| ). 

3. Evolve according to Eq. ( |2.4| ) for a time T = T(n) to arrive at \ip(T)). 

4. Measure z±, z 2 , . . . , z n in the state \tp(T)) and check if the bit string z\z 2 . . . z n satisfies 
all clauses. 

5. Repeat R{n) times. 

3 Choosing instances 

For our numerical study we randomly generate instances of the two problems under study, 
EC3 and EC2. Focus first on EC3. For a decision problem, it suffices to produce a satisfying 
assignment when one or more exists. For now, we restrict our attention to instances with a 
unique satisfying assignment. We believe that instances with only one satisfying assignment 
include most of the difficult instances for our algorithm. In fact as we will see later, our 
algorithm runs faster on instances with more than one satisfying assignment so the restriction 
to a unique satisfying assignment appears to restrict us to the most difficult cases. 

With the number of bits fixed to be n, we generate instances of EC3 as follows. We 
pick three bits at random, uniformly over the integers from 1 to n. (The bits must all be 
different.) We then have a formula with one exact cover clause. We calculate the number 
of satisfying assignments. We then add another clause by picking a new set of three bits. 
Again we calculate the number of satisfying assignments. We continue adding clauses until 
the number of satisfying assignments is reduced to one or zero. If there is one satisfying 
assignment we accept the instance. If there are none we reject the instance and start again. 
Using this procedure the number of clauses is not a fixed function of the number of bits 
but rather varies from instance to instance. For EC3 we find that the number of clauses is 
typically close to the number of bits. 
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We follow a similar procedure for EC2. When we add a clause we randomly specify 
which two bits are involved in the clause. Again we repeat this procedure until there are 
two satisfying assignments (or none in which case we discard the instance). We stop at 
two satisfying assignments because EC2 has a bit negation symmetry. If w±W2 ■ ■ ■ w n is a 
satisfying assignment so is W1W2 . . . w n and accordingly there are no instances with a single 
satisfying assignment. For EC2 the number of clauses is typically close to the number of 
bits. 

We know that EC2 is classically computationally simple but of course there is no guar- 
antee that quantum adiabatic evolution will work well on EC2. We choose instances of EC2 
with two satisfying assignments to parallel as closely as possible our study of EC3. 

4 Numerical simulation 

We are exploring the quantum adiabatic evolution algorithm by numerically simulating a 
perfectly functioning quantum computer. The quantum computer takes an initial state 
|^(0)), given by Eq. ( |2.18| ), and evolves it according to the Schrodinger equation ( |2.4| ), for 
a time T, to produce \ip(T)). The Hamiltonian H(t) is given by Eq. ( |2.8| ) with Hp and H B 
determined by the instances of satisfiability being studied. 

If the number of bits is n, the dimension of the Hilbert space is 2 n . This exponential 
growth in required space is the well-known impediment to simulating a quantum computer 
with many bits. For our modest numerical investigation, using Macs running MATLAB for a 
few hundred hours, we can only explore out to 16 bits. We integrate the Schrodinger equation 
using a variable step size Runge-Kutta algorithm, checking accuracy by keeping the norm of 
the state equal to unity to one part in a thousand. Since the number of bits is modest, we 
can always explicitly determine the ground state (or ground states) of Hp. Given \if)(T)) and 
the ground state (or states) of Hp we can calculate the probability that a measurement of 
Z\, Z2, ■ ■ ■ , z n will give a satisfying assignment by taking the sum of the squares of the inner 
products of \ip(T)) with |u>i)|u>2) • • • \w n ) where the bit strings u>iu>2 . . . w n are the satisfying 
assignments. 

5 The median time to achieve probability 1/8 

Our goal in this paper is to explore the running time T(n) and the repetition number R(n) 
that will give a successful algorithm. To this end we first determine the typical running 
time needed to achieve a fixed probability of success for a randomly generated instance with 
n bits for 7 < n < 15. In particular we determine the median time required to achieve a 
success probability of 1/8. Since this is a numerical study we actually hunt for a time that 
produces a probability between 0.12 and 0.13. For each n between 7 and 15, for both EC3 
and EC2, we find the median of 50 randomly generated instances. 

In Figure [T] the circles represent the data for EC3 and the solid curve is a quadratic fit 
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Exact Cover: Three-bit clauses 



35 



30 



10 



I 

- 






I 


I 


I 




















/q 


- 












, 


- 












/o 
























/ 














7 


i 9 


10 


11 


12 


13 


14 


15 16 



number of bits 



Figure 1: Exact Cover with three-bit clauses. Each circle is the median time to achieve 
probability between 0.12 and 0.13 for 50 instances. The curve is a quadratic fit to the data. 



to the data. At each number of bits the times required to reach probability 1/8 range from 
roughly half the median to twice the median. For this range of n, a quadratic, or even linear 
fit, is clearly adequate. The exponential 1.618 (1.215) n is also a good fit. In the next section 
we show a situation where an exponential fit to the data is required for the same range of n. 

We know of one anomalous instance (discovered by Daniel Preda, outside of the data 
collected for this paper) with 11 bits and a time to achieve probability 1/8 of close to 300. 
However, at T = 14.57, which is the value of the quadratic fit in Figure [1] at n = 11, 
the probability of success for this instance is already 0.0606. Because this probability is 
not anomalously low, the algorithm proposed in Section [7| will have no difficulty with this 
instance. 

In Figure ^| the circles represent the data for EC2 and the solid curve is a linear fit to the 
data. Here the maximum time required to reach probability 1/8, for each number of bits, is 
roughly 20% greater than the median. 



6 Destroying the bit structure of the Hamiltonian 



The Hamiltonian H(t) is a sum of terms Hc{t) each of which involves only the few bits 
mentioned in clause C; see Eq. ( |2.19| ). Each H c {t) is associated with a subspace of the 
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Exact Cover: Two-bit clauses 
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Figure 2: Exact Cover with two-bit clauses. Each circle is the median time to achieve 
probability between 0.12 and 0.13 for 50 instances. The curve is a linear fit to the data. 



Hilbert space corresponding to the satisfying assignments of clause C, that is, the space 
spanned by the ground states of H P , C ; see Eq. ( [2.13|) . Quantum adiabatic evolution (for 
T big enough) yields a state in the intersection of the subspaces associated with all of the 
clauses. Our intuition is that the bit structure of these subspaces is crucial to the success of 
the quantum algorithm. 

To test this intuition we destroy the bit structure of the Hamiltonian and run the algo- 
rithm again. Specifically consider the classical energy function that counts the number of 
violated clauses 

K z ) = H h c(z ic ,z jc , z kc ) (6.1) 



c 



where z = z 1 z 2 
that 



Now let 



z n and he is given in Eq. (2.12). From Eq. ( |2.13| ) and Eq. ( f2.14| ) we have 
H P {\z 1 )\z 2 )---\z n ))=h(z)\z 1 )\z 2 }---\z n ). (6.2) 



^SCRAM 



z) = h(U(z)) 



(6.3) 



where II is a random permutation of the integers {0, 1, 2, . . . , 2 n — 1}. Note that II is not a 
permutation of the bits but rather a random scrambling of all 2 n of the z's. 
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Let 

#SCRAM,P (\zi) \z 2 ) ■ ■ ■ \z n )) = ZlsCRAM (z) \zt) \z 2 ) ' ' • \z n ) (6.4) 

and accordingly 

H SC RAu(t) = (1 - t/T) H B + (t/T) # S CRAM,p. (6.5) 

The spectrum of -£Tscram,p is identical to that of Hp but the relationship between the eigen- 
values and the values of z has been scrambled. Accordingly the spectrum of -HscramW is 
not equal to the spectrum of H(t) except at t = and t = T. If Hp has a unique ground 
state so does i^scRAM.p and for T large enough we expect (again by the adiabatic theorem) 
that quantum evolution by -^scramW will bring us to the ground state of H SC ram,p- 



scrambled problem Hamiltonian 

100 l 1 1 1 1 




7 8 9 10 11 12 

number of bits 

Figure 3: Exact Cover with two-bit clauses and a scrambled problem Hamiltonian. Each 
circle is the median time to achieve probability between 0.12 and 0.13 for 100 instances. The 
solid line on this log plot represents an exponential fit to the data. 

Once the bit structure has been destroyed, finding the minimum of /iscram(z) is essen- 
tially the problem of minimizing an arbitrary function defined on{0,l,2,...,2 n — 1}. Solving 
this problem requires exponential time even on a quantum computer [2, 3]. To confirm this 
we generated 100 instances of EC2 for each of n — 7, 8, 9, 10, 11, 12. For each instance we 
generate a random permutation II and quantum evolve with -£^scram(£) for time T. In Fig- 
ure |3] we show the median time T required to achieve a success probability of 1/8. The linear 
behavior of the data on the log plot indicates an exponential growth as a function of n and 
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the solid line represents 0.0689 (1.7565) n . In contrast with the data in Figures |l] and [^, the 
data in Figure |3| cannot be well fit by a quadratic. 

7 Probabilities of success at a proposed running time 

Figures [L] and |2|, at least by comparison with Figure [3], indicate that the median times 
required to achieve probability 1/8, for EC3 and EC2 with 7 < n < 15, grow modestly with 
n. Thus the fitted medians, for EC3 and EC2, are reasonable candidates for the running 
times T(n) of our algorithm for these two problems. Automatically, with these run times, 
our algorithm will achieve a success probability of at least 1/8 for about half of all instances. 
Our goal now is to explore how low the success probability can get at these run times. To 
this end we generate 100 new instances of EC3 and EC2 for each n. Now n runs from 7 
to 16 for EC3 and from 7 to 15 for EC2 and T{n) is given by the fit to the data shown in 
Figures p] and 0. 
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Figure 4: Exact Cover with three-bit clauses. Probability of success at the proposed running 
time. Circles represent the medians of 100 instances at each number of bits. Triangles are 
the 10 th lowest probabilities and X's are the lowest. 



Figure |] displays the results for EC3. For each value of n from 7 to 16 we show the 
median probability of success at T(n) as well as the smallest of the 100 probabilities and the 
10 th smallest. It is no surprise that the median probability is close to 1/8 for all values of n. 
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The fact that the smallest probability does not decrease with n was not anticipated. This 
means that, at least for the range of the number of bits considered, the number of repetitions 
R(n) can be taken to be constant with n to achieve a fixed desired probability of success. 



Exact Cover: Two-bit clauses 
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Figure 5: Exact Cover with two-bit clauses. Probability of success at the proposed running 
time. Circles represent the medians of 100 instances at each number of bits. Triangles are 
the 10 th lowest probabilities and X's are the lowest. 

In Figure the data for EC2 is presented. Here the run time T(n) is given by the linear 
fit to the data in Figure [| Again the median probability at each value of n is close to 1 /8 
as is expected. However, even for this classically easy problem we had no guarantee that the 
worst case probability would not decrease with n. In fact it does not appear to decrease at 
all. 

In order to show that the running time T(n) must increase with n to produce a success- 
ful algorithm, we explore the success probabilities obtained when using an n-independent 
running time. More specifically for the EC3 instances used to generate Figure [| we run 
the algorithm for n = 7, 8, . . . , 14 for a constant value of T, the one previously used for 
n = 7. In Figure |] the log plot shows that the median success probability decreases expo- 
nentially, which means that the number of repetitions R(n) would have to grow exponentially 
to achieve a fixed probability of success. 

In Section || we gave evidence that the bit structure is crucial to the success of the 
quantum adiabatic evolution algorithm. We make this point again by taking the instances of 
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Figure 6: Exact Cover with three-bit clauses running at T = 5.82 for all numbers of bits. 
Circles represent the median probability of 100 instances. The straight line behavior on the 
log plot shows an exponential decrease in success probability. 



EC3, for n — 7, 8, . . . , 14, and running the algorithm with T(n) given by the fit in Figure [I 
but with H(t) replaced by -£/scram(£)- In Figure [7], the median probability of success is 
seen to decrease exponentially with n. This helps confirm our intuition that the quantum 
adiabatic evolution algorithm takes advantage of the bit structure inherent in the problem. 



8 Instances of EC3 with more than one satisfying assignment 

All of the EC3 data presented up to this point was generated from instances with unique 
satisfying assignments. Now we explore EC3 instances with more than one satisfying as- 
signment. As in Section |3] clauses are added at random but now instances are accepted as 
soon as the number of satisfying assignments is 6, 7, 8, or 9. If adding a clause reduces the 
number of satisfying assignments from more than 9 to less than 6, the instance is rejected. 
We do this with 100 instances for 10, 11, 12, and 13 bits and run at the same times T(n) 
used for instances with a unique satisfying assignment to generate Figure |j. 

In Figure [8] we show the median probability, the smallest probability, and the 10 th smallest 
for these instances. At the running times used, the median probability for instances with 
unique satisfying assignments is close to 1/8 (for any number of bits). For the instances 
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Figure 7: Exact Cover with three-bit clauses with a scrambled problem Hamiltonian. The 
running time is given by the quadratic fit shown in Figure |l| The log plot shows an expo- 
nential decrease in success probability. 



with multiple satisfying assignments the medians are about 1/3 and the worst case has 
a probability of about 1/8. This substantiates our intuition that instances with unique 
satisfying assignments are generally the most difficult for the quantum adiabatic algorithm. 

At the running times explored in this paper transitions out of the instantaneous ground 
state are not uncommon. In the case of a unique satisfying assignment such a transition 
(assuming no transition back) leads to a final state that does not correspond to the satisfying 
assignment. In the case of multiple satisfying assignments such transitions may lead to states 
that are headed towards the subspace spanned by the satisfying assignments. This is why the 
success probabilities are typically higher when there is more than one satisfying assignment. 



9 Discussion 

We have presented numerical evidence that a quantum adiabatic evolution algorithm can 
solve instances of satisfiability in a time that grows slowly as a function of the number of 
bits. Here we have worked out to 16 bits, but with more computing power instances with 
higher numbers of bits can be studied. 

This algorithm operates in continuous time. The algorithm can be written as a product of 
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Figure 8: Exact Cover with three-bit clauses and 6, 7, 8, or 9 satisfying assignments. Circles 
represent the medians of 100 instances at each number of bits. Triangles are the 10 th lowest 
probabilities and X's are the lowest. Compare with Figure |]. 



few-qubit unitary operators where the number of factors in the product is of order T{n) 2 
times a polynomial in n. However, understanding the idea behind the algorithm is obscure 
in the conventional quantum computing paradigm. (A quantum algorithm for satisfiability 
that is explicitly within the ordinary paradigm is presented in ||.) 

The algorithm studied in this paper works by having the quantum system stay close to the 
ground state of the time-dependent Hamiltonian that governs the evolution of the system. 
We imagine that protecting a device that remains in its ground state from decohering effects 
may be easier than protecting a device that requires the manipulation of excited states. 
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